Density estimates and concentration inequalities 

with Malliavin calculus 



Ivan Nourdin* and Frederi G. Viens^ 
Universite Paris 6 and Purdue University 



Abstract 

We show how to use the Malliavin calculus to obtain density estimates of the 
law of general centered random variables. In particular, under a non-degeneracy 
condition, we prove and use a new formula for the density p of a random variable 
Z which is measurable and differentiable with respect to a given isonormal Gaussian 
process. Among other results, we apply our techniques to bound the density of 
the maximum of a general Gaussian process from above and below; several new 
results ensue, including improvements on the so-called Borell-Sudakov inequality. We 
then explain what can be done when one is only interested in or capable of deriving 
concentration inequalities, i.e. tail bounds from above or below but not necessarily 
both simultaneously. 



Key words: Malliavin calculus; density estimates; concentration inequalities; fractional Brown- 
ian motion; Borell-Sudakov inequality; suprema of Gaussian processes. 

2000 Mathematics Subject Classification: 60G15; 60H07. 



1 Introduction 

Let N be a zero-mean Gaussian random vector, with covariance matrix K G S"+(M.). Set 
^max := max i-Kii) an d consider 

Z — max Ni — E( max JVA (1.1) 

l<i<n v l<i<n ' ' 
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It is well-known, see e.g. Vitale [16], that for all z > 0, 



P(Z > z) ^exp (~2^— ) if^>0- (1.2) 
The corresponding left-tail probability bound analogue of (II .2D also holds, see e.g. Borell 

P(Z < -z) ^ exp (~2^~) if z < °- ( L3 ) 
Of course, we can combine (11.21) and (11.3H to get, 

P(\Z\ >z) ^2exp('--^- N ) if*>0. (1.4) 

Inequality (|1.4p is a special case of bounds for more general Gaussian fields. Such bounds 
are often collectively known as Borell-Sudakov inequalities. These can be extended much 
beyond the Gaussian realm; see for instance the book of Ledoux and Talagrand [TOj. Yet 
these Borell-Sudakov inequalities can still be improved, even in the Gaussian framework; 
this is one of the things we will illustrate in this paper. 

Inequality ( 11.41) is also a special case of results based on almost sure bounds on a random 
field's Malliavin derivatives, see Viens and Vizcarra [15]. While that paper uncovered a 
new way to relate scales of regularity and fractional exponential moment conditions with 
iterated Malliavin derivatives, it failed to realize how best to use these derivatives when 
seeking basic estimates such as ( 11.41) . In the present paper, our aim is to explain how to 
use Malliavin calculus more efficiently than in [15] in order to obtain bounds like (11.21) or 
(II .3p , and even often much better. For instance, by applying our machinery to Z defined 
by (jl.ll) . we obtain the following. 

Proposition 1.1 With N and Z as above, if a^ in := mim, j > 0, with <r max : = 
m&XiKu, the density p of Z exists and satisfies, for almost all 2 6 R, 

E\Z\ ( z 2 \ , v E\Z\ ( z 2 \ 

" max \ ^ mm / mm V max / 

This proposition generalizes immediately (see Proposition 13.111 in Section [3] below) to 
the case of processes defined on an interval [a, b] C R. To our knowledge, that result is the 
first instance where the density of the maximum of a general Gaussian process is estimated 
from above and below. As an explicit application, let us mention the following result, 
concerning the centered maximum of a fractional Brownian motion (fBm) , which is proved 
at the end of Section [3l 
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Proposition 1.2 Let b > a > 0, and B = (B t , t ^ 0) be a fractional Brownian motion 
with Hurst index H G (1/2, 1). Then the random variable Z = sup[ ob ] B — i?(sup[ a6 ] i?) 
/ias a density p satisfying, for almost all z G R: 

||le-^p(,K^e-^. (1.6) 

Of course, the interest of this result lies in the fact that the exact distribution of supuy B 
is still an open problem when H ^ 1/2. Moreover, note that introducing a degeneracy 
in the covariances for stochastic processes such as fBm has dire consequences on their 
supremas' tails; for instance, with a = 0, Z has no left hand tail, since Z ^ — Ey supr 6 i B) 
a.s., and therefore p is zero for z small enough. 

Density estimates of the type (11.51) may be used immediately to derive tail estimates 
by combining simple integration with the following classical inequalities: 

Z f°° _Z 1 a£ 
<° 2 ^ / e 2 dy ^ - e 2 for all z > 0. 



1 + z 2 J z z 

The two tails of the supremum of a Gaussian vector or process are typically not symmetric, 
and neither are the methods for estimating them; this poses a problem for the techniques 
used in [16] and [2], and for ours. Let us therefore first derive some results by hand. For 
a lower bound on the right-hand tail of Z, no heavy machinery is necessary. Indeed let 
io = argmaxj Ku and p = E^maxN^ > 0. Then, for z > 0, 

p ( z > ,) , p(n k > „ + ,) > JL ^;>^ )2 «-S3£. (i.7) 

A nearly identical argument leads to the following upper bound on the left-hand tail of Z: 

for z > 0, 

P(Z < < exp (~^4A ■ (1.8) 

V ^ V^(z-fj) V 2min i ^y V ; 

This improves Borell's inequality (1 1 . 3 j) asymptotically. 

By using the techniques in our article, the density estimates in ( 11.51) allow us to obtain 
a new lower bound result on Z's left hand tail, and to improve the classical right-hand tail 
result of (11.21) . We have for the right-hand tail 

E\Z\aL„ z ( z 2 \ „,„ E\Z\(rl„ 1 



^ u max u mm ' A 



-(-i)^(^^^i exp (-i) (L9) 



if 2 > 0, and one notes that the above right-hand side goes (slightly) faster to zero than 
( 11 M . because of the presence of the factor z" 1 ; yet the lower bound is less sharp than 
( 11.71) for large z. The first and last expressions in ( II .91) are also lower and upper bounds 
for the left-hand tail P(Z ^ — zj. To the best of our knowledge, the lower bound is new; 
the upper bound is less sharp than (11.81) for large z. 
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Let us now cite some works which are related to ours, insofar as some of the pre- 
occupations and techniques are similar. In [6], Houdre and Privault prove concentration 
inequalities for functional of Wiener and Poisson spaces: they have discovered almost-sure 
conditions on expressions involving Malliavin derivatives which guarantee upper bounds 
on the tails of their functionals. This is similar to the upper bound portion of our work in 
Section 4, and closer yet to the first-chaos portion of the work in [15]; they do not, however, 
address lower bound issues, nor do they have any claims regarding densities. 

Decreusefond and Nualart [5] obtain, by means of the Malliavin calculus, estimates for 
the Laplace transform of the hitting times of any general Gaussian process; they define 
a monotonicity condition on the covariance function of such a process under which this 
Laplace transform is bounded above by that of standard Brownian motion; similarly to how 
we derive upper tail estimates of Gaussian type from our analysis, they derive the finiteness 
of some moments by comparison to the Brownian case. However, as in [6], reference [5] 
does not address issues of densities or of lower bounds. 

General lower bound results on densities are few and far between. The case of uniformly 
elliptic diffusions was treated in a series of papers by Kusuoka and Stroock: see [9]. This 
was generalized by Kohatsu-Higa [8] in Wiener space via the concept of uniformly elliptic 
random variables; these random variables proved to be well-adapted to studying diffusion 
equations. E. Nualart p3] showed that fractional exponential moments for a divergence- 
integral quantity known to be useful for bounding densities from above (see formula (11.101) 
below), can also be useful for deriving a scale of exponential lower bounds on densities; the 
scale includes Gaussian lower bounds. However, in all these works, the applications are 
largely restricted to diffusions. 

We now introduce our general setting which will allow to prove (11.5l) - (11.6p and several 
other results. We consider a centered isonormal Gaussian process X = {X(h) : h G fj} 
defined on a real separable Hilbert space S). This just means that X is a collection of 
centered and jointly Gaussian random variables indexed by the elements of ft, defined on 
some probability space (f2, cP, P) and such that, for every h,g £ $), 

E(X(h)X{g)) = {h,g) Si . 

As usual in Malliavin calculus, we use the following notation (see Section [2] for precise 
definitions): 

• L 2 (f2, & , P) is the space of square-integrable functionals of X. This means in par- 
ticular that & is the cx-field generated by X\ 

• D 1 ' 2 is the domain of the Malliavin derivative operator D with respect to X. Roughly 
speaking, it is the subset of random variables in L 2 (f2, J^, P) whose Malliavin deriva- 
tive is also in L 2 (Q, JP, P); 

• Dom<5 is the domain of the divergence operator 5. This operator will really only 
play a marginal role in our study; it is simply used in order to simplify some proof 
arguments, and for comparison purposes. 
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From now on, Z will always denote a random variable of O 1,2 with zero mean. Recall 
that its derivative DZ is a random element with values in Sj. The following result on the 
density of a random variable is a well-known fact of the Malliavin calculus: if DZ/\\DZ\\^ 
belongs to Dom<5, then Z has a continuous and bounded density p given, for all z G M, by 



p(z) = E 



l(z,+oo](Z) ^ 



DZ 



(1.10) 



From this expression, it is sometimes possible to deduce upper bounds for p. Several 
examples are detailed in Section 2.1.1 of Nualart's book [12]. Note the following two 
points, however: (a) it is not clear whether it is at all possible to prove (jl.51) by using 
(11.101) : (b) more generally it appears to be just as difficult to deduce any lower-bound 
relations on the density p of any random variable via (11.101) . 

Herein we prove a new general formula for p, from which we easily deduce (11.5ft for 
instance. For Z a mean-zero r.v. in D 1 ' 2 , define the function g : IR — > M almost everywhere 

by 

g(z) = g z (z) := E ( (DZ, -DL^Z)^ Z = z) . (1.11) 

The L appearing here is the so-called generator of the Ornstein-Uhlenbeck semigroup, 
defined in the next section. We drop the subscript z from gz in this article, since each 
example herein refers to only one r.v. Z at a time. By [TTl Proposition 3.9], g is non- 
negative on the support of Z. Under some general conditions on Z (see Theorem 13. II for a 
precise statement), the density p of Z is given by the following new formula, for any z in 
Z's support: 

i \ / n , E\Z\ ( f z xdx\ , 

p < ze ^=^=4r xp (~X i¥)) iz - (U2) 



The key point in our approach is that it is possible, in many cases, to estimate the 
quantity g(z) in ( 11.111) rather precisely. In particular, we will make systematic use of the 
following consequence of the Mehler formula (see Remark 3.6 in [11]), also proved herein 
(Proposition 13.51) : 

POO 

g(z)= / e~ u E«$ Z (X), ^ z (e~ u X + y/l - e-^X'))^Z = z)du. 
Jo 

In this formula, the mapping $z : ^ — ^ i3 is defined P o X _1 -almost surely through the 
identity DZ = &z(X), while X', which stands for an independent copy of X, is such that 
X and X' are defined on the product probability space (Q x Q', j^® j^', P x P') \ E denotes 
the mathematical expectation with respect to P x P' . This formula for g then allows, in 
many cases, to obtain via (11.121) a lower and an upper bound on p simultaneously. We 
refer the reader to Corollary 13.61 and the examples in Section [HI and in particular to the 
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second and fourth examples, which are the proofs of Proposition 11.11 and Proposition 11.21 
respectively. At this stage, let us note however that it is not possible to obtain only a lower 
bound, or only an upper bound, using formula (11.121) . Indeed, one can see that one needs 
to control g simultaneously from above and below to get the technique to work. 

In the second main part of the paper (Section [4]), we explain what can be done when one 
only knows how to bound g from one direction or the other, but not both simultaneously. 
Note that one is precisely in this situation when one seeks to prove the inequalities (11.21) and 
(II .3p . These will be a simple consequence of a more general upper bound result (Theorem 
IP) in Section H 

As another application of Theorem 14.11 the following result concerns a functional of 
fractional Brownian motion. 

Proposition 1.3 Let B = {B t , t £ [0, T]} be a fractional Brownian motion with Hurst 
index H £ (0, 1). Then, denoting ch = H + 1/2, we have, for any z > 0: 

p (jf b> > , + r-7(2e H) ) < exp (- 2CttT2 f»? +TiHM ) ■ 

Of course, the interest of this result lies in the fact that the exact distribution of J Q T B\du 
is still an open problem when H ^ 1/2. With respect to the classical result by Borell [1] 
(which would give a bound like exp(— Cz)), observe here that, as in Chatterjee [3], we get a 
kind of "continuous" transition from Gaussian to exponential tails. The behavior for large 
z is always of exponential type. At the end of this article, we take up the issue of finding 
a lower bound which might be commensurate with the upper bound above; our Malliavin 
calculus techniques fail here, but we are still able to derive an interesting result by hand, 
see (ET28j) . 

Section [H also contains a lower bound result, Theorem 14.21 again based on the quantity 
(DZ, —DLr^Z)^ via the function g in (jl.lip . This quantity was introduced recently in 
[TT] for the purpose of using Stein's method in order to show that the standard deviation 
of (DZ, —DL~ l Z) sj provides an error bound of the normal approximation of Z, see also 
Remark 13.21 below. Here, in Theorem 14.21 and in Theorem 14.11 as a special case (a = 
therein), g(Z) = E((DZ, —DL~ 1 Z) f} \Z) can be instead assumed to be bounded either 
above or below almost surely by a constant; this constant's role is to be a measure of the 
variance of Z, and more specifically to ensure that the tail of Z is bounded either above 
or below by a normal tail with that constant as its variance. Our Section [4] can thus be 
thought as a way to extend the phenomena described in [llj when comparison with the 
normal distribution can only be expected to go one way. Theorem 14.21 shows that we may 
have no control over how heavy the tail of Z may be (beyond the existence of a second 
moment), but the condition g(Z) ^ cr 2 > essentially guarantees that it has to be no less 
heavy than a Gaussian tail with variance cr 2 . 

We finish this description of our results by stressing again that, whether in Sections [3] or 
[U we present many examples where the quantities (DZ, —DL~ l Z)^ and (<3>z(A), <3>z(e~ u X+ 
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VI — e~ 2 "X'))^, are computed and estimated easily, by hand and/or via Proposition 13.51 
The advantage over formulas such as (11.1 Op , which involve the unwieldy divergence operator 
S, should be clear. 

The rest of the paper is organized as follows. In Section 2, we recall the notions of 
Malliavin calculus that we need in order to perform our proofs. In Section 3, we state 
and discuss our density estimates. Section 4 deals with concentration inequalities, i.e. tail 
estimates. 



2 Some elements of Malliavin calculus 

We follow Nualart's book [12]. As stated in the introduction, we denote by X a centered 
isonormal Gaussian process over a real separable Hilbert space i). Let & be the a-field 
generated by X. It is well-known that any random variable Z belonging to L 2 (Q, & , P) 
admits the following chaos expansion: 

oo 

Z=X>4/m), (2-13) 
m=0 

where /o(/o) = E(Z), the series converges in L 2 (Q) and the kernels f m £ f) 0m , m ^ 
1, are uniquely determined by Z. In the particular case where S) = L 2 (A, , /i), for 
(A, &f) a measurable space and \i a a-finite and non-atomic measure, one has that f) 0m = 
L 2 (A m , £/® m , /i 0m ) is the space of symmetric and square integrable functions on A m and, 
for every / £ S) Qm , I m (f) coincides with the multiple Wiener-Ito integral of order m of / 
with respect to X. For every m ^ 0, we write J m to indicate the orthogonal projection 
operator on the mth Wiener chaos associated with X. That is, if Z £ L 2 (Q, P) is as in 
(12.131) . then J m F = I m {f m ) for every m ^ 0. 

Let y be the set of all smooth cylindrical random variables of the form 

Z = g(X{<k),...,X{<f> n )) 

where n ^ 1, g : W 1 — >Eisa smooth function with compact support and fa £ S). The 
Malliavin derivative of Z with respect to X is the element of L 2 (fl,Sj) defined as 

DZ = J2^(X(fa),...,X(cf> n ))fa. 

i=l 1 

In particular, DX{h) = h for every h £ Sj. By iteration, one can define the mth derivative 
D m Z (which is an element of L 2 (Vt, fj 0m )) for every m ^ 2. As usual, for m ^ 1, D m ' 2 
denotes the closure of 5? with respect to the norm || ■ || m2 , defined by the relation 

m 

11^11^2 = E{Z 2 ) + Y. E (W DiZ Wl^)- 

1=1 



7 



Note that a random variable Z as in (12. 13ft is in IB) 1,2 if and only if 

oo 

^mm! ||/ m |||®m < oo, 



m=l 



and, in this case, £'(||I?Z||^) = Xl m ^i mm! ll/m|||®m- If # = L 2 (A,£/, fi) (with /x non- 
atomic) , then the derivative of a random variable Z as in ( 12.131) can be identified with the 
element of L 2 (A x Q) given by 

oo 

DgZ = y^m/ m _i(/ m (-,q)), oGA. 

m=l 

The Malliavin derivative D satisfies the following chain rule. If <p : M. n — > M is of class 
with bounded derivatives, and if {Zi}i=i,..., n is a vector of elements of D 1 ' 2 , then 
(p(Z 1 , . . . , Z n ) G D 1,2 and 

n 

D(p(Zi, ...,Z n ) = J2 q^(Zu • • • , ^)£>Z,. (2.14) 

Formula (12.141) still holds when <p is only Lipshitz but the law of (Z\, . . . , Z n ) has a density 
with respect to the Lebesgue measure on W 1 (see e.g. Proposition 1.2.3 in [T2]). 

We denote by 8 the adjoint of the operator D, also called the divergence operator. A 
random element u G L 2 (Q, Sj) belongs to the domain of 5, denoted by Dom5, if and only if 
it satisfies 

\E(DZ, u)sj\ < c u E(Z 2 ) 1/2 for any Z e^, 

where c u is a constant depending only on u. If u G Dom5, then the random variable 8(u) 
is uniquely defined by the duality relationship 

E{Z8{u))= E(DZ,u)^ (2.15) 

which holds for every Z G D 1,2 . 

The operator L is defined through the projection operators as L = J2m=o ~ m ^rn-, and is 
called the generator of the Ornstein-Uhlenbeck semigroup. It satisfies the following crucial 
property. A random variable Z is an element of DomL (= D 2,2 ) if and only if Z G DomSD 
(i.e. Z G D 1,2 and DZ G Dom5), and in this case: 

5DZ = -LZ. (2.16) 

We also define the operator L" 1 , which is the inverse of L, as follows. For every Z G 
L 2 (Q, , P), we set L~ X Z = J2 m >i ~~Jm{Z)- Note that L^ 1 is an operator with values 
in D 2 ' 2 , and that LL~ X Z = Z - E(Z) for any Z G L 2 (Q,^,P), so that L~ l does act as 
L's inverse for centered r.v.'s. 
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The family (T u , u ^ 0) of operators is defined as T u = Ylm=o e ~ m "4) an d is called 
the Orstein-Uhlenbeck semigroup. Assume that the process X\ which stands for an inde- 
pendent copy of X, is such that X and X' are defined on the product probability space 
(Q x Q', & <g> P x P'). Given a random variable Z e D 1,2 , we can write DZ = $z(X), 
where &z is a measurable mapping from R- 9 to f), determined PoX _1 -almost surely. Then, 
for any u ^ 0, we have the so-called Mehler formula: 



where E 1 denotes the mathematical expectation with respect to the probability P' . 

3 Density estimates 

For Z G ID 1,2 with zero mean, recall the function g introduced in the introduction in (11.111) : 

g(z) = E((DZ, -DL- 1 Z) S j\Z = z). 

It is useful to keep in mind throughout this paper that, by [HI Proposition 3.9], g(z) ^ 
on the support of Z. In this section, we further assume that g is bounded away from 0. 

3.1 General formulae and estimates 

We begin with the following theorem, which will be key in the sequel. 

Theorem 3.1 Let Z e D 1 ' 2 with zero mean, and g as above. Assume that there exists 
°~mm > such that 

g(Z) ^ almost surely. (3.18) 

Then Z has a density p, its support is M and we have, almost everywhere: 



Proof. We split the proof into several steps. 

Step 1: An integration by parts formula. For any / : R — > R of class ^ with bounded 
derivative, we have 



T U (DZ) = E'(<f> z (e- u X + Vl-e~ 2u X')), 



(2.17) 




(3.19) 



E(Zf(Z)) = E(LL^Zf{Z)) = E(5D(-L- 1 Z)f(Z)) by (2Jl) 



= E((Df(Z), -DL- x Z)s) by (EE) 



= E(f'(Z)(DZ, -DL-'Z)^) by (EH]). 



(3.20) 



9 



Step 2: Existence of the density. Fix a < b in R. For any e > 0, consider a ^°°-function 
ip £ : R — > [0, 1] such that <p e (2) = 1 if 2 G [a, b] and <p e (z) = if z < a — e or z > 5 + e. We 
set ipe( z ) = /_ <Pe(y)dy for any z6R. Then, we can write 

P(a^Z^b)=E(l [aM (Z)) 

< (7 m ^(l H (Z)£((Z)Z, -DZT^IZ)) by assumption (jHSj) 
= ^E(l M (Z)<D2r, —DL~ X Z)$^ 

= a m lE(]immicp £ (Z)(DZ,-DL- l Z) Sj ) 

e— >0 

< (J mm liminf E(tp e (Z)(DZ, -DL^Z)^) by Fatou's inequality 
= <7^ liminf by([320l) 

= cr m i n E ^Z J l[ a>b j(u)du\ by bounded convergence 
f E(Zl [Ut+oo) (Z))du < (6-o) x 



-2 
min 



This implies the absolute continuity of Z, that is the existence of p. 

Step 3: A key formula. Let / : R — > R be a continuous function with compact support, 
and F denote any antiderivative of /. Note that F is bounded. We have 

E(f(Z)(DZ, -DL- x Z)s>) = E(F(Z)Z) by $2M) 

F(z) z p{z)dz 



(*) 



/ ^ (/ VP ^ dy ) dz 

Iz yp(y)dy\ 



Elf(zy 



p(z) J ■ 

Equality (*) was obtained by integrating by parts, after observing that 



poo 

/ yp(y)dy — ► as \z\ —* oo 

J z 



(for z — > +oo, this is because Z e L x {£l)\ for z — > — oo, this is because Z has mean zero). 
Therefore, we have shown 

g(Z) = E((DZ, -DL~ l Z)^\Z) = ^ y P^ dy almost surely . ( 3 . 2 l) 

Step 4-' The support of p. Since Z e ID 1 ' 2 , it is known (see e.g. (T2J Proposition 2.1.7]) 
that Suppp = [a,/3] with — oo ^ a < [3 ^ +oo. Since Z has zero mean, note that a < 
and /3 > necessarily. Identity (13.211) yields 

/■oo 

/ y p (y) dy ^ cr min p (z) for almost all 2 G (a, (3). (3.22) 

J z 
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For every z G (ck,/3), define <p(z) := f°° yp (y) dy. This function is differentiable almost 
everywhere on (a,0), and its derivative is — zp(z). In particular, since <p(ai) = <p(P) = 0? 
we have that <p(z) > for all z G (a, (3). On the other hand, when multiplied by z G [0, ft), 
the inequality (13.221) gives ^-pr ^ — #— . Integrating this relation over the interval [0,2;] 

^\ Z ) °"min 

yields log^O) - log^(0) ^ -j^, i.e., since = E(Z) = E(Z + ) - E(Z_) so that 

min 

E\Z\ = E(Z+) + E{Z_) = 2E(Z + ) = 2^(0), we have 

1 



tp{z) = J yp (y) dy > ^E\Z\e . (3.23) 
Similarly, when multiplied by z G (a, 0], inequality ( 13.22ft gives ^-14 ^ — #-. Integrating 

^V- 2 / °"min 

this relation over the interval [z, 0] yields log <p (0) — log <p (z) ^ „ z z , i.e. ( 13.23ft still holds 

min 

for z G (a, 0]. Now, let us prove that f3 = +oo. If this were not the case, by definition, we 
would have ip {(3) = 0; on the other hand, by letting z tend to (3 in the above inequality, 



because (p is continuous, we would have (p (0) ^ \E\Z\e 2a mm > 0, which contradicts 
(3 < +oo. The proof of a = — oo is similar. In conclusion, we have shown that suppp = R. 

Step 5: Proof of ( EXgj . Let <p : R -> R be still defined by p(*0 = yp{y)dy. On 
one hand, we have <p'(z) = —zp(z) for almost all z G R. On the other hand, by (13.211) . we 
have, for almost all z G R, 

<p(z) = p(z)g(z). (3.24) 

By putting these two facts together, we get the following ordinary differential equation 
satisfied by ip: 

'p'(z) z 

— — = — — for almost all z G R. 

<PW 9K Z ) 

Integrating this relation over the interval [0, z\ yields 

f x dx 

logip(z) = log 99(0) - / — -. 

Jo 9{x) 

Taking the exponential and using the fact that <^(0) = \E\Z\, we get 

( \ 1 pi vl ( [ z xdx 
tp[z) = - E\Z\ exp 



□ 



to #0), 

Finally, the desired conclusion comes from ( 13.24ft . 



11 



Remark 3.2 The "integration by parts formula" $3. 20\) was proved and used for the first 
time by Nourdin and Peccati in /71]/ . in order to perform error bounds in the normal 
approximation of Z . Specifically, /71]/ shows, by combining Stein's method with ^3.20A) . that 



to write this slight improvement; it was not stated or used in /II]/ because it did not improve 
the applications therein. 



Using Theorem 13.11 we can deduce the following interesting criterion for normality, 
which one will compare with ( 13.25( 1. 

Corollary 3.3 Let Z e P 1 ' 2 ; let g(Z) = E((DZ, -DL- l Z)^\Z). Then Z is Gaussian if 
and only ifVax(g(Z)) = 0. 

Proof: We can assume without loss of generality that Z is centered. By ( 13.201) (choose 
f(z) = z), we have 

E({DZ, —DL~ x Z)fi) = E(Z 2 ) = VarZ. 

Therefore, the condition Var(g(Z)) = is equivalent to 

g(Z) = VarZ almost surely. 

Let Z ~ jV{^,o 2 }. Using (13.21(1 . we immediately check that g(Z) = a 2 almost surely. 
Conversely, if g(Z) = a 2 almost surely, then Theorem 13.11 implies that Z has a density p 

E\Z\ 

given by p(z) = -^r^^ for almost all z G K, from which we immediately deduce that 



Observe that if Z ~ ^(O^a 2 ), then E\Z\ = \/2pK a, so that the formula (13.19ft for p 
agrees, of course, with the usual one in this case. 

Depending on the situation, g(Z) may be computable or may be estimated by hand. 
We cite the next corollary for situations where this is the case. However, with the exception 
of this corollary, the remainder of this section, starting with Proposition 13.51 provides a 
systematic computational technique to deal with g(Z). 

Corollary 3.4 Let Z e P 1 ' 2 with zero mean and g(Z) := E((DZ, - D L~ l Z) %\Z) . If there 
exists o" m i n ,cr max > such that 

°min ^ g( z ) < °"max almost surely, 
then Z has a density p satisfying, for almost all z G M 




Z~^(0,a 2 ). 



□ 




Proof: One only needs to apply Theorem 13.11 



□ 
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3.2 Computations and examples 

We now show how to compute g(Z) := E({DZ, —DL~ l Z)?\Z) in practice. We then provide 
several examples using this computation. 

Proposition 3.5 Write DZ = $>z(X) with a measurable function <3> z '■ ^ — ► £)• We have 

POO 

g(Z) = / e-" E(($ Z (X), ^ z (e~ u X + Vl - e~^X')) ^\Z)du, 
Jo 

where X' stands for an independent copy of X, and is such that X and X' are defined on 
the product probability space (Q x fi', & ® P x P'). Here E denotes the mathematical 
expectation with respect to P x P' . 

Proof: We follow the arguments contained in Nourdin and Peccati [HI Remark 3.6]. 
Without loss of generality, we can assume that = L 2 (A, /x) where (A, &/) is a measur- 
able space and \x is a a-finite measure without atoms. Let us consider the chaos expansion 
of Z, given by Z = E"=i Wm), with f m G Sj &m . Therefore —Lr x Z = £~ =1 ~I m (fm) 
and 

oo 

-D a L- l Z= Im-i(fm(; a)), aeA 

m=l 

On the other hand, we have D a Z = Y^m=i m ^rn-i(fm('j a ))- Thus 

POO / 00 \ 

' u T u (D a Z)du = J e~ u ^me-^ v I m -i(f m (-,a))J du 

oo 

= ^ J m-l(/m(-,a))- 



e 



m=l 



Consequently, 

POO 

-DL~ 1 Z= j e~ u T u (DZ)du. 
Jo 

By Mehler's formula ( 12 .171) . and since DZ = $ Z (X) by assumption, we deduce that 

POO 

-DL~ l Z= / e- u E'($ z (e- u X + y/l - e~ 2u X'))du. 
Jo 

Using E(E'(. . -)\Z) = E(. . . \Z), the desired conclusion follows. 



□ 



By combining ( 13 . 1 9f) with Proposition 13.51 we get the formula (11.121) given in the intro- 
duction, more precisely: 
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Corollary 3.6 Let Z G B 1,2 be centered, and let $z '■ ^ — * ft be measurable and such 
that DZ = Assume that condition $3.18\) holds. Then Z has a density p given, 

for almost all z G R, by 

(\ ElZl 



2 J °° e-« E(($ Z (X), $ z (e-I + y/1 - e-^X'))^\Z = z)du 

x dx 

x exp 



J °° e-«E(($spO, $ z (e-«X + Vl-e- 2u X')) fl |Z = 



Now, we give several examples of application of this corollary. 



3.2.1 First example: monotone Gaussian functional, finite case. 

Let N ~ <sK.(0, K) with K G ^ n + (K), and / : K n -> R be a function having bounded 
derivatives. We assume, without loss of generality, that each JVj has the form X(hi), for 
a certain centered isonormal process X (over some Hilbert space Sj) and certain functions 
hi G f>. Set Z = f(N) - E(f(N)). The chain rule <\2A^i implies that Z G D 1 ' 2 and that 
DZ = $ Z (7V) = £» =1 ^(JV)^. Therefore 

$,(e- tt I + Vl - e- 2 «X')) A = J2 K i3 ^-{N)^-{e~ u N + Vl - e'^N'). 

t-^ OXi OXj 

l,J=l J 

(Compare with Lemma 5.3 in Chatterjee [4]). In particular, Corollary 13.61 yields the fol- 
lowing. 

Proposition 3.7 Let N ~ ^(0, K) with K G ^„ + (M), and / : R n -> R 6e a function 
with bounded derivatives. If there exist a>i, ^ suc/i £Aa£ aij ^ §^( x ) ^ A / or an 2/ 
i G {1, . . . , n) and x G R n , i/ i<Qj ^ for any i,j G {1, . . . , n} and if Y17j=i a i a jKij > 0; 
then Z = f(N) — E(f(N)) has a density p satisfying, for almost all z G K, 

z 2 

exp 



E \ z \ I 
^ Pi*) ^ jF~ ex P 



3.2.2 Second example: proof of Proposition [TTTl 

Let iV ~ jV n (Q,K) with K G ,^+(R). Once again, we assume that each A/j has the form 
X(hi), for a certain centered isonormal process X (over some Hilbert space fj) and certain 
functions hi G fj. Let Z = maxiVj — E (max Ni), and set 

4 = argmax 1<i<n (e~"X(/i l ) + y/l - e^x'fa)) for u ^ 0. 
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Lemma 3.8 For any u ^ , I u is a well-defined random element of {1, ... ,n}. Moreover, 
Z E D 1 - 2 and we have DZ = $ Z (N) = h Io . 

Proof: Fix u ^ 0. Since, for any i ^ j, we have 

P(e- u X{hi) + Vl - e- 2u X'(h t ) = e~ u X(h 3 ) + Vl - e- 2u X\h 3 )) 

= P(X(hi)=X(hj)) =0, 

the random variable I u is a well-defined element of {1, . . . ,n}. Now, if Aj denotes the set 
{x E E n : Xj ^ Xi for all j}, observe that £-max = 1a, almost everywhere. The desired 
conclusion follows from the Lipshitz version of the chain rule (I2.14p . and the following 
Lipshitz property of the max function, which is easily proved by induction on n ^ 1: 

n 

| max(yi, ...,y n )- max(xi, ...,x n )\ ^ ] 2/» - Xi\ for any x,y E R n . (3.26) 

i=l 

□ 

In particular, we deduce from Lemma [3.81 that 

($z(X), $ z (e- u X + Vl - e- 2 «X')) A = K IoJu . (3.27) 

By combining this fact with Corollary 13.61 we get Proposition ll.il which we restate. 

Proposition 3.9 Let N ~ JKSS^i K) with K E J?^~(E). If there exists a min , cr max > such 
that cr 2 lin ^ Kij ^ &max f or an D e {!)••• 5 n h % = niaxiVj — i?(maxA r i ) /ias a 
density p satisfying ( CP)) /or almost all z E E. 



3.2.3 Third example: monotone Gaussian functional, continuous case. 

Assume that X = (X f , t e [0, T]) is a centered Gaussian process with continuous paths, 



and that / : E — > E is with a bounded derivative. Consider Z = J Q f(X v )dv — 
E (7 Q T f(X v )dv). Then Z e D 1,2 and we have DZ = $ Z (X) = f'(X v )l M dv. There- 
fore 



($ Z (X), $ z (e-"X + Vl - e-*»X'))i5 

= // f{X v )f\e- u X w + Vl - e-^X' w )E(X v X w )dvdw. 

J J[0,T] 2 

Using Corollary 13.61 we get the following. 

Proposition 3.10 Assume that X = (X t , t E [0, T]) is a centered Gaussian process with 
continuous paths, and that f : E — > E is < ^ 1 . If there exists a, (3, o~ m i n , o~ max > smc/i i/iai 
a < /'(a;) < /3 /or all x E E and cr^ in ^ £(X„X W ) < o- 2 iax /or a// v,w E [0,T\, then 

Z = f(X v )dv — E ^ J Q T f{X v )dv s j has a density p satisfying, for almost all z E E, 
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3.2.4 Fourth example: supremum of a Gaussian process 

Fix a < b, and assume that X = (X t , t G [a, b]) is a centered Gaussian process with 
continuous paths and such that E\X t — X s \ 2 ^ for all s ^ t. Set Z = sup[ afe ]X — 
-E^sup^ X), and let r u be the (unique) random point where e~ u X + \Jl — e~ 2u X' attains 
its maximum on [a, b}. Note that r u is well-defined, see e.g. Lemma 2.6 in [7]. Moreover, we 
have that Z G D 1 ' 2 , see Proposition 2.1.10 in [12], and DZ = = l[o, To ], see Lemma 

3.1 in [5]. Therefore 

($z{X), <5>z(e~ u X + Vl - e- 2 «X')) A = i2(r , r tt ) 

where i?(s, i) = E(X s X t ) is the covariance function of X. Using Corollary l3.6l the following 
obtains. 

Proposition 3.11 Let X = (X t , t G [a, b]) be a centered Gaussian process with continuous 
paths, and such that E\X t — X s \ 2 ^ for all s ^ t. Assume that, for some real cr min , <j max > 
0, we have o^ in < E(X s X t ) < a^ x for any s, t G [a, b]. Then, Z = sup [a6] X-E(sup [ab] X) 
has a density p satisfying, for almost all z G M, 

E\Z\ --4- , \ E\Z\ ?L_ 

7TY^ e min < P( z ) < e 2 ™- 

max min 

To the best of our knowledge, Proposition 13.111 as well as Proposition 13.91 contain the 
first bounds ever established for the density of the supremum of a general Gaussian pro- 
cess. When integrated over z, the upper bound above improves the classical concentration 
inequalities (11.21) . (II. 3B . (11.41) on the tail of Z, see e.g. the upper bound in (11.91) ; the lower 
bound for the left-hand tail of Z which one obtains by integration, appears to be entirely 
new. When applied to the case of fractional Brownian motion, we get the following. 

Corollary 3.12 Let b > a > 0. and B = (B t , t ^ 0) be a fractional Brownian motion with 
Hurst index H G [1/2, 1). Then the random variable Z = sup[ a b ] B — ^(sup^ has a 
density p satisfying U.6\) for almost all z G M. 

Proof: For any choice of the Hurst parameter H G (1/2, 1), the Gaussian space gener- 
ated by B can be identified with an isonormal Gaussian process of the type X = {X{h) : 
h G $)}, where the real and separable Hilbert space is defined as follows: (i) denote by 
$ the set of all IR- valued step functions on R + , (ii) define Sj as the Hilbert space obtained 
by closing £ with respect to the scalar product 

(l m , l M ) fi = E(B t B s ) = \{t 2H + s 2H - \t - s\ 2H ). 

In particular, with such a notation, one has that B t = X(l[ 0>t ]). The reader is referred e.g. 
to |12| for more details on fractional Brownian motion. 
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Now, the desired conclusion is a direct application of Proposition 13.111 since, for all 
a ^ s < t < b. 



E(B s B t ) < ^E[Bf)^E{B 2 ) = (st) H < b 2H 

and 

E(B s B t ) = -(t 2H + s 2H -(t- s) 2H ) = H(2H - 1) // \v - u\ 2H ~ 2 dudv 

2 J J[0,s]x[0,t] 

> H(2H - 1) ff \v- u\ 2H - 2 dudv = E(B 2 a ) = a 2H . 

J J[0,a}x[0,a] 



□ 



4 Concentration inequalities 

Now, we investigate what can be said when g(Z) = E((DZ, —DL~ 1 Z)? ) \Z) just admits 
a lower (resp. upper) bound. Results under such hypotheses are more difficult to obtain 
than in the previous section, since there we could use bounds on g(Z) in both directions to 
good effect; this is apparent, for instance, in the appearance of both the lower and upper 
bounding values cr m i n and <r max in each of the two bound in (11.51) . or more generally in 
Corollary I3.4L However, given our previous work, tails bounds can be readily obtained: 
most of the analysis of the role of g(Z) in tail estimates is already contained in the proof 
of Theorem I3.ll 



4.1 Upper bounds 

Our first result allows comparisons both to the Gaussian and exponential tails. 

Theorem 4.1 Let Z G D 1 ' 2 with zero mean, g{Z) = E((DZ, - D 'L' 1 Z) %\Z) , and fix a ^ 
and (3 > 0. Assume that 

(i) g(Z) ^ aZ + (3 almost surely; 
(ii) Z has a density p. 

Then, for all z > 0, we have 
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Proof: We follow the same line of reasoning as in [HI Theorem 1.5]. For any A > 0, 
define m A : [0, +oo) — > E by m A {9) = £ , (e 0Z l{^^A}) ■ By Lebesgue differentiation theorem, 
we have 

m' A (9) = E(Ze 9Z l {z ^A}) for all 9^0. 
Therefore, we can write 

r A 

m' A {9) = / ze ez p(z)dz 

J — oo 

POO pA / POO \ 

= — e eA / yp(y)dy + 9 / e 6 ^ I / yp(y)dy J ciz by integration by parts 

</yl J-oc Viz / 

^ 61 / e ^ (/ Vp ^ dy ) dz since IT yp(y) d y ^ 

= 9E(g(Z)e ez l {z<A} ), 
where the last line follows from identity (13. 21ft . Due to the assumption (z), we get 

m' A {9) ^ 9am' A (9) + 9f3m A (9), 
that is, for any 9 G (0, 1/a): 
rr4(0) < 0/3 



m A (0) l-0a' 

By integration and since m A (0) = P[Z ^ A) ^ 1, this gives, for any G (0, 1/a): 
m A(9) ^ exp ( / — du ) ^ exp 



l-au J * \2(1 - 6a), 
Using Fatou's inequality (as A — > oo) in the previous relation implies 

E(e ez ) ^ exp 



2(1 -9a) 

for all 9 G (0, 1/a). Therefore, for all 9 G (0, 1/a), we have 
P(Z >z) = P(e ez ^ e 6z ) ^ e~ ez E(e ez ) ^ exp (-^ 



9z 



9a) 

Choosing 9 = G (0, 1/a) gives the desired result. ^ 

Let us give an example of application of Theorem 14. 1[ Assume that B = (B t , t ^ 0) is 
a fractional Brownian motion with Hurst index H G (0, 1). For any choice of the parameter 
H, as already mentioned in the proof of Corollary 13.121 the Gaussian space generated by 
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B can be identified with an isonormal Gaussian process of the type X = {X(h) : h £ fj}, 
where the real and separable Hilbert space S) is defined as follows: (i) denote by $ the set 
of all R- valued step functions on K + , (ii) define 9) as the Hilbert space obtained by closing 
<§ with respect to the scalar product 

(lM. = E i B tBs) = \{t 2H + - |t - s\ 2H ). 

In particular, with such a notation one has that B t = X(l[o tt ]). Now, let 

fT rp2H + l 

Z T ■= I Bldu 



2H 



By the scaling property of fractional Brownian motion, we see first that Zj- has the same 
distribution as T 2H+1 Zi. Thus we choose T = 1 without loss of generality; we denote 
Z = Z\. Now observe that Z £ ID 1 ' 2 lives in the second Wiener chaos of B. In particular, 
we have — L~ X Z = \Z. Moreover DZ = 2 f Q B u l[ 0)U ]d«, so that 



(DZ, -DL-^n = h\DZ\\% = 2 [ B U B V E(B u B v )dudv 
1 ^[o,i] 2 

^2/ \B u \\B v \\E(B u B v )\dudv 



^ 2 / \B U \ \B V \ u H v H dudv = 2 ( / \B u \u H du 
'[o,i] 2 \Jo 

Bldu x / u 2H du = H+1 ^ 2 J Bldu 

z 1 



u 



H + 1/2 V 2H + 1 

Since it is easily shown that Z has a density, Theorem 14.11 implies the desired conclusion 
in Proposition 11.31 or with c# = H + 1/2, 



P {Z x ^ z) ^ exp 



7 2 2 



2c H z + 1 



By scaling, this shows that the tail of Zt/T 2H+1 behaves asymptotically like that of an 
exponential random variable with mean v = (H/2 + 1/4) -1 . 

For the moment, it is not possible to use our tools to investigate a lower bound on this 
tail, see the forthcoming Section l4~2l We have also investigated the possibility of using such 
tools as the formula (II .101) . or the density lower bounds found in [13], thinking that a specific 
second-chaos situation might be tractable despite the reliance on the divergence operator, 
but these tools seem even less appropriate. However, in this particular instance, we can 
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perform a calculation by hand, as follows. By Jensen's inequality, with \x = (2H + 1) , 
we have that Z + fi = Zi+fi^ (^f^ B u duj . Thus 



P(Z 1 >z)>p(^^ B u du^j 



2 



^ z + n) =P 



B„du 



o 



> y/z + fj. • 



Here of course, the random variable N = J 1 B u du is centered Gaussian, and its variance 
can be calculated by hand: 

a 2 := E (N 2 ) = [[ E (B U B V ) dudv 

J J[0,l} 2 

Therefore, by the standard lower bound on the tail of a Gaussian r.v., that is e~ y2 ^ 2 dy ^ 
_z_ e -z 2 /2 ^ Qr a jj 2 > g ? we g e t 



P (Zi ^ z) ^ exp ' 



a 2 + z + fi V 2cr2 

ex P (-^T7^ ) ex P (" ( H + 1) *) ■ ( 4 - 28 ) 



*^°°y/zy/2H + 2 \ 2H 

Abusively ignoring the factor 2 _1//2 in this lower bound, we can summarize our results by 
saying that Zt/T 2H+1 has a tail that is bounded above and below by exponential tails with 
respective means (H/2 + 1/4) -1 and (H + l) -1 . 

As another example, let us explain how Theorem 14.11 allows to easily recover both the 
Borell-Sudakov-type inequalities (11.21) and (11.31) . for Z defined as the centered supremum 
of a Gaussian vector in (11.11) . We can assume, without loss of generality, that each A 7 , has 
the form X(hi), for a certain centered isonormal process X (over some Hilbert space i}) 
and certain functions hi £ $j. Condition (ii) of Theorem 14.11 is easily satisfied while for 
condition (i), we have, by combining ( 13.271) with Proposition 13.51 : 



POD 

(DZ, -DL^Z)^ = / e- u K IoJu du < max K t . 



C (4-29) 



so that 

g(Z) ^ <r max almost surely. 

In other words, condition (i) is satisfied with a = and (3 = (J^ ax . Therefore P(Z ^ z) ^ 
exp ( — r. Z 2 ) , for all z > 0, and (11.21) is shown. The proof of (11.31) follows the same lines, 

\ * "max / 

by considering — Z instead of Z. 
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4.2 Lower bounds 

We now investigate a lower bound analogue of Theorem l4.il Recall we still use the notation 
g(z) =E((DZ,-DL- 1 Z)„\Z = z). 

Theorem 4.2 Let Z £ D 1 ' 2 with zero mean, and fix cr m i n ,a > and j3 > 1. Assume that 
(i) g(Z) it^jjj almost surely. 

The existence of the density p of Z is thus ensured by Theorem \3.1[ Also assume that 
(ii) the function h (x) := x 1+/3 p (x) is decreasing on [a, +oo). 
Then, for all z ^ a, we have 

P(Z > z) > ~ ( 1 - \ ) E\Z\ - exp / 



Alternately, instead of (ii), assume that there exists < a < 2 such that 
(ii)' Mmsup^^ z~ a log g(z) < oo. 

Then, for any e > 0, there exist K, z > such that, for all z > z , 

P(Z ^ z) ^ K exp 



z 2 



(2-e)a 



2 

min 



Proof: First, let us relate the function <p(z) = J°° yp(y)dy to the tail of Z. By integra- 
tion by parts, we get 

POO 

<p(z)= z P(Z > z)+ P(Z > y)dy. (4.30) 

J z 

If we assume (ii), since h is decreasing, for any y > z ^ a we have fg} < (§) . Then we 
have, for any z ^ a: 

By putting that inequality into (|4.30p . we get 

i r°° i 

<p(z) ^zP(Z^z) + -J yp(y)dy = z P(Z > z) + - tp{z) 
so that P(Z ^ z) ^ ^1 — j^J Combined with (13.231) . this gives the desired conclusion. 

21 



Now assume (ii)' instead. Here the proof needs to be modified. From the key result of 
Theorem 13.11 and condition (i), we have 



E\Z\ 



■ exp 



2 a 



Let ^ (z) denote the unnormalized Gaussian tail J z °° exp 
the Schwarz inequality, 



'— ) dy. We can write, using 



so that 

P(Z ^ z) 



exp 



2 a 



\fgiy) 



dy 



exp 



2 a 



g{y) dy x 



exp 



2a^ 



P (y) dy 



E\Z\ 
E\Z\ 



g{y) v 

m 2 (z) 



f°°e y2 ^/( 2cr min) g (y) dy 



Using the classical inequality e y2 ^ 2 dy ^ 



1+ Z 2 e 



-z 2 /2 



we get 



P(Z ^ z) ^ 



a 4 - 



exp 



— 

mm 



2 Kin + ^) r° ex p 



g(y)dy 



g(y) 



dy 



(4.31) 



Under condition (ii)', we have that there exists c > such that, for y large enough, 
g(y) ^ e cya with < a < 2. We leave it to the reader to check that the conclusion now 
follows by an elementary calculation from (14.311) . 



□ 



Remark 4.3 1. Inequality h4-31\) itself may be of independent interest, when the growth 
of g can be controlled, but not as efficiently as in (ii)' . 

2. Condition (ii) implies that Z has a moment of order greater than (3. Therefore it 
can be considered as a technical regularity and integrability condition. Condition (ii) 1 
may be easier to satisfy in cases where a good handle on g exists. Yet the use of 
the Schwarz inequality in the above proof means that conditions (ii)' is presumably 
stronger than it needs to be. 
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3. In general, one can see that deriving lower bounds on tails of random variables with 
little upper bound control is a difficult task, deserving of further study. 
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